1?F tutorial 

^Smm i 

DSP for analog engineers 

Most DSP applications require some analog or RF support circuitry. Having an un- 
derstanding of the DSP portion of the system is useful to the analog designer 



By Mark Kolber 



rjlhe most simple digitial signal pro- 
X cessing (DSP) system consists of 
only an analog-to-digital (A/D) con- 
verter and a digital-to-analog (D/A) 
converter. However, some of the signal 
processing that can take place in the 
digital domain must be considered. (See 
Figure L) 

A/D conversion 

Analog signals are continuous in 
time and continuous in amplitude, ex- 
isting at every instant of time with any 
possible intermediate amplitude value. 
DSPs mathematically process signals 
represented as a series of numbers that 
are discrete in time and discrete in am- 
plitude. A/D conversion consists of sam- 



pling, hold, quantize and code. 
Sometimes these four functions are in- 
tegrated into one device. (See Figure 2.) 

Sampling 

Sampling converts a signal that is 
continuous in time to one that is dis- 
crete in time. The number of samples 
taken per-second is called the sampling 
rate or sampling frequency Fs. The 
Nyquist theorem says that, if sampling 
is performed at a rate exceeding the 
Nyquist rate, or 2 times the bandwidth 
of the signal, no signal information is 
lost. Sampling can be thought of as a 
re-mapping of the frequency domain. 
The input frequencies exist in a line 
that extends from zero to infinity. The 
line is rolled up into a circle where the 
sampling rate Fs, which is normalized 
to 2pi, is mapped back to Hz or DC. 
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Figure 1 . A simple DSP system. 



Audio signals recorded on compact 
discs (CDs) extend from 20 Hz to 20 
kHz and are sampled at Fs = 44.1kHz. 
Telephone channels with voice compo- 
nents between 300 Hz and 3 kHz are 
usually sampled at Fs = 8 kHz. 

Similarly, the upper bandwidth limit 
Fs/2, called the folding frequency or 
Nyquist limit, that is normalized to pi, 
is mapped to Fs/2. After sampling, no 
frequency can exist above Fs/2. Any 
input signal component that exceeds 
the folding frequency, Fs/2, will be 
aliased or folded back and will reap- 
pear below the folding frequency. For 
example, if Fs = 8 kHz, the folding fre- 
quency is 4 kHz. An input signal com- 
ponent at 7 kHz, which is 3 kHz above 
the folding frequency, will be aliased to 
3 kHz below the folding frequency and 
will reappear as a 1 kHz signal. Note, 
when an input signal between Fs/2 and 
Fs is aliased back to the region between 
and Fs/2, it appears spectrally in- 
verted just as if it had been frequency- 
translated using a mixer with high side 
injection. (See Figure 3.) 

The Z transform converts between 
the time domain and this rolled up fre- 
quency domain in a way analogous to 
the way that the fourier transform con- 
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Figure 2. Analog-to-digital conversion. 
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Figure 4. Subsampling. 



verts between the time domain and the 
normal straight-line frequency domain. 

Anti-alias lowpass filters are used to 
attenuate input signal components 
above the folding frequency before sam- 
pling. The design must consider the 
transition bandwidth and finite rejec- 
tion of the filter, as well as any noise 
and distortion products above Fs/2 that 
may be re-generated after the filter be- 
cause these will all be aliased and will 
reappear below the folding frequency. 

Subsampling is a useful form of 
aliasing used to downconvert and 
sample bandpass signals that are cen- 
tered above Fs/2. The Nyquist criterion 
is not violated, and no information is 
lost as long as Fs/2 exceeds the band- 
width of the input signal. For example, 
a 20 kHz-wide IF signal centered on 
455 kHz can be subsampled using Fs = 
110 kHz. The 4th harmonic of Fs, 440 
kHz, will alias the 455 kHz center fre- 
quency down to 15 kHz. A bandpass, 
rather than a lowpass filter, is used to 
limit the bandwidth of the input signal 
to prevent unwanted aliasing. 
Depending on the relationship between 
the bandwidth and the center fre- 
quency of the input signal, the min- 
imum usable sampling rate will lie be- 
tween 2B and 4B where B is the 
bandwidth of the signal. (See Figure 4.) 

Ideally, sampling is performed at ex- 
actly equally spaced time intervals. 
Any unwanted variation in the time in- 
terval is called aperture jitter. This is 
equivalent to phase noise on the sam- 
pling frequency, which will be imparted 
to the sampled signal. In many ways, 



sampling is analogous to frequency con- 
version using a mixer or multiplier. 
Sampling multiplies the input signal by 
a series of impulses. The resulting fre- 
quency translation is analogous to 
using a mixer with an LO that contains 
harmonics. Conversions that use har- 
monics of the LO are analogous to 
aliasing or subsampling. 

Hold and quantize 

After sampling, the signal is discrete 
in time but it is still continuous in am- 
plitude. The signal is made discrete in 
amplitude as well by quantizing or rep- 
resenting each sample as a number 
with finite resolution. For example, this 
can be accomplished with a series of 
comparators. A hold function may be 
used to maintain the sampled value 
constant during the time it takes to 
quantize the signal. 

Some of the techniques for quan- 
tizing include: successive approxima- 
tion, integration, flash and iterative. 
Successive approximation converters 
use a D/A converter, comparator and 
control logic to perform a binary 
search for the digital value that is as 
close as possible to the input value. 
Integration-type converters use a 
ramp and a comparator to start and 
stop a digital counter whose output 
represents the value of the sample. 
These are relatively slow techniques, 
so these converters are primarily used 
for data rather than signal acquisition. 
Flash converters use a bank of com- 
parators and voltage references, one 
for each quantization level. This con- 
verter is fast and is often used for 
signal acquisition. However, the 
number of comparators required rises 
exponentially with the number of 
output bits. Iterative converters use a 
smaller flash converter in a multistep 
sequence that results in a compromise 
between speed and cost. 

Unlike Nyquist sampling, which 
loses no information, quantizing pro- 
duces an error called quantizing noise. 
Because the hardware cannot process 
an infinite number of bits, the ampli- 
tude of the signal cannot be represented 
with infinite resolution. The difference 
between the exact sample value and the 
quantized value is quantizing error. 
Quantizing noise can usually be approx- 
imated as white noise if the input signal 
is continuously varying, is large com- 
pared to the difference in quantizing 
levels, and does not contain frequency 
components that are related to the sam- 



pling rate. Dithering, or adding a 
known signal to the input, is sometimes 
used to ensure the white noise approxi- 
mation is valid. The dithering signal 
can be subtracted or filtered out in the 
digital domain. Under these conditions, 
the signal-to-quantizing noise ratio 
(SNR) is approximately; 

SNR(dB) = (6.02 • n) + 1.25 

and the number of possible signal am- 
plitude levels is: 

L = (2 n )-1 
where: 

SNR = the signal to quantizing noise 
ratio in dB 

n = the number of binary bits 
used to represent the levels 

1 = the number of possible quan- 
tization levels 

Increasing the binary word size by 
one bit doubles the number of quantiza- 
tion levels and improves the SNR by 
about 6 dB. Audio CDs use 16 bits, pro- 
viding an SNR of about 98 dB. The dy- 
namic noise and linearity performance 
of practical A/D converters operating at 
RF frequencies are often specified by 
the effective-number-of-bits (ENOB) 
available, which is usually less than 
the actual number of output bits. 

Oversampling is a technique that 
uses a sampling rate higher than the 
Nyquist rate. Because quantizing noise 
is spread over the full spectrum from 
to Fs/2, if the signal occupies only a 
small portion of this range, much of the 
quantizing noise can be filtered out 
using DSP filters. Thus, over-sampling 
allows for the tradeoff of sampling rate 
vs. resolution. Sigma delta modulation 
is another technique for reducing the 
effects of quantization. It quantizes the 
changes in a signal between samples 
rather than the signal itself. These two 
techniques are combined in a sigma 
delta converter that uses a very high 
speed 1-bit sigma delta A/D and digital 
filtering to create a converter with ex- 
cellent linearity. 

A form of logarithmic quantizing 
often used for telephony called Mu-law 
coding uses non-linear quantizing 
where the quantized number is propor- 
tional to the logarithm of the signal. 
The quantizing steps effectively repre- 
sent decibel values rather than volts. 
This causes the quantizing noise to be 
larger when the signal is large and 
smaller when it is small. Because the 
log of is negative infinity, practical 
Mu-law converters must deviate from a 
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Figure 5. Sigma delta conversion. 

true logarithmic transfer function 
below some small signal level. The 
exact nature of this deviation is defined 
by the particular Mu-law curve being 
used. Because of its non-linear charac- 
teristic, this type of converter is not 
usually used for DSP applications. (See 
Figure 5.) 

Coding 

Coding is the representation of the 
quantized values in a particular nu- 
merical format usually a form of bi- 
nary. Straight binary is the natural 
choice for unipolar signals. The various 
codes used for bipolar signals differ in 
their representation of the sign and the 
transition from positive to negative 
values. Examples of popular codes are 
shown in Table 1 for a 3-bit word size. 

Two's complement is often used to 
represent bipolar signals because it is a 
form of modulo arithmetic which sim- 
plifies the addition and subtraction of a 
series of numbers. As long as the final 
result is in range, the sum will be cor- 
rect in spite of the fact that some of the 
intermediate results may have been out 
of range. Multiplication, however, is 
easier using sign-magnitude represen- 
tation. 

Within a system, the A/D converter, 
numerical processing section and D/A 
converter must all use the same 
method of representation or the num- 
bers must be converted. Offset binary 
and two's complement are popular for 
DSP. Notice that converting between 
offset binary and two's complement 
simply requires inverting the most sig- 
nificant bit. 

Dynamic range considerations 

The analog input signal must be 
properly scaled to fully utilize the dy- 
namic range of the A/D converter. If the 
input signal is too small, the quantizing 
SNR will suffer. If the signal is too 
large, clipping may occur. Although 
most analog components have soft com- 
pression characteristics, exceeding the 
upper limit of an A/D converter pro- 
duces hard clipping, which is not "well- 
behaved." The resulting high-order dis- 



Tablel. 
size. 



tortion increases 
rapidly rather than 
gradually as more 
clipping occurs. 
Non-linearities 
within the dynamic 
range of the A/D 
converter can also create high-order 
distortion products. 

When the analog input contains a 
large number of signals, such as in a 
multichannel communications system, 
the dynamic range of the A/D converter 
must be carefully considered. The dy- 
namic range of the A/D converter must 
accommodate not only the range of the 
desired channel but also the total of all 
the undesired channels as well. For 
this reason, many system designs in- 
clude some analog pre-filtering to re- 
duce the number of channels and hence 
dynamic range applied to the input of 
the A/D converter. 

The driving impedance presented to 
the input of the A/D converter must 
also be considered. The various com- 
parators within the A/D converter can 
cause its input impedance to vary as a 
function of the input signal. The con- 
verter must be driven by the specified 
source impedance, usually 50 Q, in 
order to obtain the specified linearity 
performance. 

After the signal has been converted 
to the digital domain, there are addi- 
tional dynamic range considerations. 
The sum of 2 N bit numbers require 
N+l bits, and the product of 2 N bit 
numbers require 2N bits. To limit the 
number of bits needed within a system 
and also to prevent overflow, the least 
significant bits of results are usually 
rounded or truncated. This increases 
the amount of quantizing noise but pre- 
vents numerical clipping. Truncation is 
easier to implement but can cause a 
small bias in the errors, which may ac- 
cumulate. If the possibility of numer- 
ical overflow exists within the system, 
a clip function should be included to 
maintain the overflowed value at full 
scale rather than allowing it to wrap 
back around to an indeterminate 
smaller value. 
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Examples of popular codes used for bipolar signals for a 3-bit word 



Floating point binary representation 
can be used to increase the dynamic 
range available in the digital domain. 
With fixed point representation, the 
smallest value that can be represented 
is one least significant bit (LSB). The 
largest is 2(N - 1) times larger where n 
is the number of binary bits in the 
word. Floating point representation 
uses two words, one representing the 
mantissa M and the second an expo- 
nent or characteristic C. The value x is 
represented as: 

x = Mx2 c 

M can be signed to represent both 
positive and negative numbers and is 
usually normalized between 1/2 and 1. 
C can be signed to represent values 
greater, or less than, one. For a given 
number of bits, floating point is able to 
represent a much larger dynamic range 
compared to fixed point. The resolution 
of a floating point is not fixed but is 
proportional to the value of the input 
signal. The sum of two floating point 
numbers is the sum of the mantissas if 
the exponents are equal. The product of 
two floating point numbers is found by 
multiplying the mantissas and adding 
the exponents. Floating point arith- 
metic produces roundoff errors for both 
addition and multiplication; fixed point 
produces roundoff errors only for multi- 
plication. Because of the wide dynamic 
range, floating point reduces the occur- 
rence of overflow errors. The Institute 
of Electrical and Electronic Engineers 
(IEEE) standard 754 defines the details 
of a commonly used floating point rep- 
resentation. 

Digital-to-analog conversion 

In the simple DSP system, the dig- 
ital output of the A/D converter is con- 
nected directly to the input of the D/A 
converter. An ideal D/A converter will 
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generate an output voltage that exists 
for only an instant in time for each 
sample. The output value between 
samples must be interpolated by the re- 
construction filter, which will make the 
analog output again continuous in both 
time and amplitude. If the sampling 
meets the Nyquist criteria, and if the 
reconstruction filter eliminates all fre- 
quencies above the folding frequency, 
the interpolation causes no error and 
the output will be an exact replica of 
the original signal, except for the quan- 
tizing errors. 

The use of very narrow pulses at the 
output of the D/A is called impulse 
sampling and is not practical. Usually 
the D/A output is held constant for the 
full duration between samples. This is 
called natural sampling. The hold func- 
tion is a form of interpolation or recon- 
struction filtering that causes an error 
called sin x/x error or aperture loss, 
which is a small (<4 dB) roll-off of the 
higher frequencies. This error is easily 
corrected with a small amount of high- 
frequency peaking called sin x/x com- 
pensation. This peaking is usually built 
into the reconstruction filter, but it can 
also be included within the digital pro- 
cessing section. 

Glitch energy is another error associ- 
ated with the practical hardware im- 
plementations of the D/A converters. 
Glitch energy is noise created during 
the transition between one sample 
value and the next. This can be caused 
by timing skew between the various 
bits in the binary word or simply by 
crosstalk from the D/A digital input to 
the analog output. Glitch energy can be 
minimized by timing the sample and 
hold to capture each sample value only 
after the D/A output has settled, but 
before the next sample arrives. 
Isolation between the digital and 
analog sections of the system is also 
needed. (See Figures 6 and 7.) 

Digital processing 

In the simple system, the A/D output 
was connected directly to the D/A 
input. Some digital communications or 
recording systems may be similar to 
this, but mathematically processing the 
signal while it is in digital form is what 
DSP is all about. 

FIR and IIR filters 

Most filters can be described as 
causal linear-time invariant (CLTI). 
Causal indicates that the present 
output depends on the present and the 



past but not on the future. Linear indi- 
cates that the output is the result of ad- 
dition or multiplication of the input by 
a constant. The input cannot be multi- 
plied by itself so the transfer function is 
not a function of the input signal. This 
also means that superposition applies, 
and no new frequencies are generated. 



Perhaps most important, it means that 
the system can be completely charac- 
terized by its impulse response. Time 
invariant means the system does not 
change as a function of time. 

All types of CLTI filtering functions 
such as lowpass, highpass and band- 
pass, can be implemented using DSP 
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Figure 6. Digital to analog conversion. 

structures that consist only of delay el- 
ements, multiplications by constants 
and addition. For example, taking the 
five previous input samples, multi- 
plying each by the constant 1/5 and 
adding the results creates the average, 
which is a form of lowpass filter. 
Various types of filters can be imple- 
mented using multiply-accumulate op- 



NON-RECURSIVE FILTERS 

• No feedback from the output 

• Unconditionally stable 

• Finite impulse response (FIR) 

• Impulse response duration equal to filter 
length 

• Response is all zeroes 

• Capable of linear phase response without 
phase equalizer 

• Requires more taps for given a response 

• Feedback from output 

• Can become unstable 

• Usually infinite impulse response (IIR) in 
theory 

• Impulse response duration exceeds filter 
length in practice 

• Response contains poles and zeroes 

• Requires fewer taps for a given response 



Table 2. Comparison of non-recursive and recur- 
sive filters. 
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Figure 8. a) Third-order non-recuresive FIR filter, 
b) Third-order recursive IIR filter. 



erations that convolve the input signal 
with the filter's impulse response in the 
time domain. This is equivalent to mul- 
tiplication in the frequency domain. 

There are two fundamental types of 
CLTI filters: recursive and non-recur- 
sive. In non-recursive systems, the pre- 
sent output is created using only past 
and present inputs. (There is no feed- 
back from the output.) A recursive 
system uses both past and present in- 
puts as well as past and present out- 
puts. (There is feedback.) There are var- 
ious structures or arrangements for the 
delays and multiplier-accumulators 
that produce equivalent results. 
Canonic form structures, which include 
the direct form, minimize the number of 
delay elements or registers needed. 
Other structures, such as the parallel 
form and cascade form, require more 
computation but are less sensitive to co- 
efficient quantizing errors. This is anal- 
ogous to forms of analog filters that are 
less sensitive to component tolerances. 

The figures show examples of non-re- 
cursive and recursive third-order filters 
with the direct form I structure. The fil- 
ters contain three delay elements, and 
the outputs are the summation of four 
multiplications. The delay elements, 
represented as Z 1 functions, can be im- 
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Figure 7. 

plemented as shift registers in hard- 
ware or memory locations in software. 
The signal is advanced once per sample 
period. The four multiplication con- 
stants are represented as C1-C4 where 
the signal sample value is multiplied 
by the associated constant. 

The series of delay elements can be 
compared to a tapped delay line. The 
signals at each delay are often called 
taps, and the multiplication values as- 
sociated with each tap are often called 
the tap weights or coefficients. In a 
SAW filter, the delays are created by 
the propagation delay of the acoustical 
wave along the surface of the substrate, 
and the tap weights are controlled by 
the size of the transducer fingers. 

When an impulse is applied to the 
input of a non-recursive filter, the du- 
ration of the output or impulse re- 
sponse is equal to the length or number 
of delay elements within the filter. 
Thus, the filter has a finite impulse re- 
sponse (FIR). Due to the feedback, re- 
cursive filters theoretically can have an 
infinite impulse response (IIR). The im- 
pulse response of practical IIR filters, 
although longer than the actual length 
of the filter, does not continue indefi- 
nitely but decays exponentially to a 
negligible value. 

Sharp, high-order filtering functions 
with narrow transition bands require 
many poles and zeroes corresponding to 
many Ls and Cs in analog filters. 
Similarly, sharp filtering in DSP re- 
quires many taps. In general, recursive 
IIR filters require fewer taps to produce 
a given response. Non-recursive FIR fil- 
ters, whose impulse response is sym- 
metric in time, have exact linear phase 
response and therefore constant group 
delay within the passband, which is im- 
portant in many applications. An FIR 
filter can be used to create a Hilbert 
transform that provides a constant 90° 
phase shift over a range of frequencies. 

Non-recursive FIR filters are uncon- 
ditionally stable. Recursive IIR filters, 
however, can be unstable. Recursive fil- 
ters that are normally stable can be- 
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come unstable due to non-linearities 
caused by momentary overflows or be- 
cause of roundoff errors recirculating 
indefinitely. These forms of instability 
are called limit-cycle oscillations and 
dead band. IIR filters can also suffer 
from other non-linear phenomena such 
as jump and subharmonic responses. 
Jump occurs when the output level 
changes suddenly due to a small 
change in the input level. Subharmonic 
responses occur where the output 
signal contains subharmonics of the 
input. These phenomena are similar to 
the non-linear behavior sometimes ex- 
hibited by class C RF amplifiers and 
other non-linear systems with feed- 
back. These non-linearities can be min- 
imized by error spectral shaping that 
feeds the quantizing errors back 
through another set of taps. (See Table 
2 and Figure 8.) 

Design of FIR and IIR filters 

One method of designing an FIR 
filter to have a given frequency re- 
sponse is to find the corresponding im- 
pulse response using Fourier analysis. 
The coefficients of the direct form FIR 
filter are simply equal to the impulse 
response. Unfortunately, the Fourier 
series of a finite frequency response is 
infinitely long, and a filter with an infi- 
nite number of taps is obviously not 
practical. Truncating the series causes 
a ripple in the passband and sidelobes 
in the stopband caused by the Gibbs 
phenomenon. Windowing uses a 
gradual tapered reduction to shorten 
the series. This reduces the ripples but 
causes a widening of the transition 
band. Various windowing functions 
tradeoff widening of the main lobe and 
sidelobe attenuation. This is analogous 
to the tradeoff that must be made in 
antenna design. Table 3 lists the main 
lobe transition width vs. sidelobes of 
various windows. The response of a 
windowed filter will be the combination 
(convolution) of the window response 
and the filter response. 

Equiripple is another approach to 
the design of FIR filters where the 
maximum passband and stopband rip- 
ples are specified, just as in the design 
of Chebyshev analog filters. An itera- 
tive computer algorithm developed by 
Parks and McClellan can be used to 
find a set of coefficients that best meets 
the ripple criteria. 

IIR digital filters can be designed by 
converting an analog design to a digital 
design. This involves mapping the poles 



and zeroes of the analog filter from the 
s domain to the z domain. The matched 
z transform and impulse invariance 
method use a mapping that results in 
distortion of the frequency response, es- 
pecially near the folding frequency. The 
bilinear transform uses the arctangent 
function to create a highly non-linear 



mapping that eliminates aliasing ef- 
fects but suffers from frequency 
warping. Bessel filters that have been 
converted to IIR filters digital filters by 
these transforms, no longer retain their 
linear phase characteristics. Rather 
than convert an analog filter design to 
digital, IIR filters can be designed di- 
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rectly using iterative computer algo- 
rithms to find the optimum set of coeffi- 
cients that minimize the mean square 
error in the frequency response or any 
other desired parameter. 

As in any digital system, signal 
quantization causes quantization noise. 
In a digital filter, the tap weights must * 
also be quantized. This coefficient 
quantization does not add more noise to 
the signal, but rather causes errors in 
the desired frequency response, usually 
in the form of increased ripple in the 
passband, and a reduction of the max- 
imum attenuation in the stopband. 
These errors can also cause narrow- 
band IIR filters to become unstable. 
Arithmetic roundoff or truncation of in- 
termediate results adds noise to the 
signal and can also cause limit cycle os- 
cillations in IIR filters. 

Special techniques can be used to re- 
duce the amount of hardware or com- 
putational complexity of filter designs. 
Multiplication of one variable by an- 
other variable requires a large amount 
of hardware, and practical filters may 
require 20 to 100 multiplications. 
Fortunately, filters require multiplica- 
tions of a variable by a constant, and 
this requires less hardware. Just as in 
ordinary decimal arithmetic where 
multiplication by ION can be achieved 
by simply shifting the decimal point by 
n places, multiplication by 2N can be 
achieved in binary arithmetic by 
shifting by n places. Multiplication by 
any constant can be achieved by the 
combination of shifting and adding. For 
example, x6 can be achieved by adding 
the results of x4 and x2. This technique 
is called canonic signed digits. When 
this technique is used, one of the goals 
of the filter design is to select a set of 
coefficients that provides the desired 
response while requiring the minimum 
number of terms. 

The design of digital filters boils 
down to selecting an IIR or an FIR de- 
sign, selecting the best structure and 
then determining the correct values for 
the coefficients. FIR filters are usually 
used when linear phase response is re- 
quired, and IIR filters are used when 
linear phase is not required. In prac- 
tice, Fs, the desired filter response and 
other parameters are entered into a 
DSP computer-aided design (CAD) tool 
that calculates the required set of coef- 
ficients. The CAD tool can then display 
the actual response that will be ob- 
tained using those coefficients in- 



cluding the effects of quantizing and 
other errors. The designer can then add 
more taps, change the structure or 
make other changes as needed until an 
acceptable response is obtained. 

DSP-based FIR and IIR filters can be 
used for data acquisition filtering and 
for equalizing communications chan- 
nels. Instead of using fixed taps 
weights, adaptive filters and adaptive 
equalizers use algorithms that auto- 
matically adjust the tap weights to 
change the filter response to minimize 
errors in the signal. These are slowly 
time variant systems that typically re- 
quire 100 to 1,000 signal samples to 
converge. Because the coefficients are 
not constants, the multipliers must be 
capable of multiplying two variables 
rather than one variable by a constant. 
Echo cancellation used in telephony is 
an example of adaptive equalization. 
Adaptation can also be used as a tech- 
nique to design fixed filters. 

Modulation/demodulation 
and decimation/interpolation 

In communications systems, DSP 
can be used for modulation and demod- 
ulation or frequency translation. This 
requires that the signal be multiplied 
by a cos and a -sin carrier signal nor- 
mally requiring the multiplication of a 
variable by a variable. The hardware 
complexity required can be reduced by 
setting the carrier frequency to exactly 
Fs/4 so that the cos component of the 
carrier becomes the series 1, 0, -1, 0, 1 
etc. And the -sin component becomes 0, 
-1, 0, 1, etc. Multiplying by only these 
factors can be achieved with much less 
hardware and usually at a greater 
speed, but it requires that the carrier 
frequency have a fixed relationship to 
the sampling rate. 

This same technique can also be 
used for upconversion and downconver- 
sion. Again the LO frequency must be 
exactly equal to Fs/4. Once the signal 
has been downconverted to an IF and 
filtered to a limited bandwidth, the 
sampling rate can then be reduced by a 
process called decimation. A lower sam- 
pling rate is desirable because lower- 
speed hardware can be utilized and be- 
cause fewer taps are required to 
implement narrow band filtering. 
Decimation by an integer factor d 
simply requires selecting every dth 
sample and eliminating the rest. The 
signal must be bandlimited before deci- 
mation to avoid aliasing. 



Conversely, interpolation is used to 
increase the sampling rate by an in- 
teger factor I by inserting 1-1 new sam- 
ples between the original samples. 
Initially the inserted samples are all 
set to 0, and the output spectrum con- 
tains a periodic repetition of the orig- 
inal spectrum. The resulting signal is 
digitally lowpass-filtered, which re- 
places the inserted zero values with in- 
terpolated values and removes the un- 
desired spectral repetitions. By 
combining interpolation, filtering and 
decimation, the sample rate can by 
changed by any factor I/D. Because of 
the difficult filtering required and the 
loss of signal amplitude, sample rate 
conversion by large factors is more effi- 
ciently implemented by cascading sev- 
eral stages of conversion and filtering. 

DSP using multiple sample rates is 
known as multirate signal processing. 
Standard filter designs are available 
that have a fixed response relative to 
the sampling rate. A halfband lowpass 
filter, for example, has a -6 dB passband 
as wide as 1/2 the folding frequency or 
Fs/4. The number of taps determine the 
sharpness of the transition band. 

FFT and spectral analysis 

DSP spectral analysis is often per- 
formed using the fast Fourier transform 
(FFT). The FFT is a particularly effi- 
cient algorithm for calculating the dis- 
crete Fourier transform (DFT), which is 
the sampled version of the Fourier 
transform. The FFT transforms a signal 
from the time domain to the frequency 
domain (determines the spectral compo- 
nents of a signal). While conventional 
analog spectrum analyzers use a single 
swept filter, the FFT produces a bank of 
bandpass filters whose outputs are all 
available simultaneously. FFT algo- 
rithms derive their efficiency from 
breaking the DFT down into succes- 
sively smaller dfts. The most commonly 
used FFT algorithm was developed by 
Cooley and Tukey and requires that the 
input sequence contain N = 2 1 samples 
in time, where I is an integer. The algo- 
rithm requires approximately Nlog 2 N 
complex multiplications and generates 
n complex output samples, which are 
usually combined into N/2 real fre- 
quency points. For example, using Fs = 
1 kHz, 1,024 input points separated by 
1 ms spanning a total of 1.024 seconds 
will produce a Fourier spectrum con- 
sisting of 512 frequency points or bins 
spanning from dc to 511 Hz providing 1 
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Hz resolution. Note, the adherence to 
the Nyquist criteria in the highest 
output frequency bin is 1/2 the sam- 
pling frequency. Also, for a given sam- 
pling rate, an increase in the number of 
samples spanning a larger time period, 
results in better frequency resolution at 
the output. If a particular application 
does not require the results at all the 
output frequency bins, other algorithms 
such as the Goertzel algorithm may be 
more efficient. Another alternative, the 
chirp Z transform, does not require that 
the number of input points N be a 
power of 2, 

Some signal processing functions are 
more easily implemented in the fre- 
quency domain. In these cases, the FFT 
can be used to convert time domain sig- 
nals to the frequency domain, the nec- 
essary processing is then performed, 
and the inverse FFT is used to convert 
the signals back to the time domain. 

The input to the FFT is a finite 
length sequence representing an input 
signal. The FFT processes this input as 
if it were a continuous periodic signal 
by "splicing" the last time sample to the 
first time sample. If the actual input 
signal is periodic and the sampling rate 
is an integer multiple of the period, 
then the sampling, called commensu- 
rate, and output are accurate. If the 
input signal is not periodic or if the 
sampling rate is not synchronized to 
the period of the signal, the spectral 
output will contain errors, called 
leakage, which are similar to the side- 
lobes produced by truncating FIR fil- 
ters. The leakage can be thought of as 
errors caused by the step change occur- 
ring at the mismatched splice point. 
The leakage can be reduced by win- 
dowing the input samples to reduce the 
amplitude at the splice point, but be- 
cuase this effectively shortens the time 
sample, it also degrades the frequency 
resolution. 

The discrete cosine transform calcu- 
lates only the real part of the DFT. 
This efficient transform is useful for 
data and image compression. The 
Walsh transform and related 
Hadamard transform convert to the 
frequency domain and are based on 
harmonically related rectangular 
waves as opposed to the DFT, which is 
based on harmonically related sine and 
cosine waves. 

The cepstrum is an interesting appli- 
cation of spectral analysis. Standard 
spectral analysis looks for periodicities 



in the time domain. A signal that has 
been corrupted by an echo will have 
peaks and valleys or periodicities in the 
frequency domain because of construc- 
tive and destructive interference. A 
cepstrum can be thought of as spectral 
analysis of a spectrum which identifies 
these periodicities in the frequency do- 
main and relates them back to the time 
domain. A signal combined with a 1 ms 
echo will exhibit periodicity at 1 kHz in 
the frequency domain. The cepstrum 
will display this frequency domain peri- 
odicity as a peak at 1 ms. 
Homomorphic deconvolution is a tech- 
nique used to identify, separate and 
sometimes compensate for the effects of 
a cascaded system. This has been used, 
for example, to remove the resonance 
effects of the acoustical horn used to 
make recordings of Enrico Caruso or to 
map oil fields using reverberation data. 

Many communications signals exist 
in one dimension, i.e., they vary as a 
function of time. DSP techniques can 
also be applied to image processing 
using multidimensional signals that 
vary as a function of X and Y location 
as well as time. |Jjp 
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